Identifying the pairing symmetry in sodium cobalt oxide by Andreev edge states 
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We study the Andreev edge states with different pairing symmetries and boundary topologies 
on semi-infinite triangular lattice of Na^CoC^-j/HhO. A general mapping from the two dimensional 
lattice to the one dimensional tight-binding model is developed. It is shown that the phase diagram 
of the Andreev edge states depends on the pairing symmetry and also the boundary topology. 
Surprisingly, the structure of the phase diagram crucially relies on the nodal points on the Fermi 
surface and can be explained by an elegant gauge argument. We compute the momentum-resolved 
local density of states near the edge and predict the hot spots which are measurable in Fourier- 
transformed scanning tunneling spectroscopy. 
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I. INTRODUCTION 

The recent discovery of superconductivity in sodium 
cobalt oxide compound intercalated water molecules, 
Na^CoCVyH^OfS trigged intense attentions and stimu- 
lated lots of discussions^. The superconductivity induced 
in the planer structure of C 0O2 is similar with that in the 
Cu02 plane of cuprates^^. However, the underlaying tri- 
angular lattice of the Co atoms is fundamentally differ- 
ent from the square lattice of the Cu atoms in cuprates 
because the antiferromagnetic interactions on the trian- 
gular lattice are frustrated. The carrier density in the 
sodium cobalt oxide can be tuned by the Na concentra- 
tion. By changing the sodium doping, a rich phas e dia- 
gram appears and the superconductivity occuriP^ in the 
doping regime 1/4 < x < 1/3. Furthermore, the study 
in Co-NMR and Co-NQR found that the spin-lattice re- 
laxation rate at the critical temperature (T c ) shows no 
coherent peak and follows a power bel ow T c , hiniting an 
unconventional superconducting phase^^l. The node of 
the superconducting gap is confirmed by the specific-heat 
measurements^ and also by the muon spin relaxation 
experiments^. 

However, the symmetry of the Cooper pairs remains 
unknown at present. In order to identify the pair- 
ing symmetry, the measurement of spin susceptibility in 
the su percond ucting state through the Knight shift is 
helpfxiP^EMS The measurements of the powder sam- 
ples show that the Knight shifts along the c-axis do not 
decrease below T c , r aising th e possibility of spin-triplet 
superconducting stat d 13 * 1 ^ 5 -! On the other hand, recent 
measurements on the single-crystal samples^ show that 
the Knight shift decreases below T c along the a- and c- 
axes, which suggests for the spin-singlet pairing instead. 
From the study of the normal-state Fermi surface topol- 
ogy by the angle-resolved photoemission spectroscopy^ 
and the Mn doping effects^, it also seems to support the 
singlet superconducting state. Thus, the pairing symme- 
try of superconductivity in Naa;Co02-yH20 compounds 
remains controversial at the point of writing. 

There are also theoretical efforts to pin down the pair- 



ing symmetry of the gap function in Na^CoOj^- The 
underlaying triangular lattice is proposed to host the 
resonating- valence-bond (RVB) state for an unconven- 
tional superconductor^. Base on the R VB pic ture, the- 
oretical investigations on the t-J modepQ^ favor the 
d x 2_ y 2 + id xy symmetry. However, within the third- 
order perturbative expansions, a stable /-wave pairing 
is found in the Hubbard modeP^ with repulsive on- 
site interaction. The same conclusion is reached from 
the theoretical study on the single-band extended Hub- 
bard model within random phase approximations^. Fur- 
thermore, recent discovery of the Hubbard-Heisenberg 
model on the half-filled anisotropic triangular lattice 
show that varying the frustration t' /t changes the spatial 
anisotropy of the spin correlations and leads to transi- 
tions of the pairing symmetries of the superconducting 
oder parameter's! Taking different routes for theoretical 
investigations, other g roups demonstrate the possibility 
of the p x + ip y pairing2SEZl j n addition, starting from 
the fluctuation-exchange approximations, the triplet /- 
wave and p-wave pairings are favored on the triangular 
lattice^. With the same approximations, solving the lin- 
earized Eliashberg equation^ leads to dominant pairing 
in the spin-triplet /-wave sector. Therefore, the pairing 
symmetry also posts a challenging task for theoretical 
understanding from the microscopic perspective. 

While it is important to determine the pairing sym- 
metry from microscopic approaches, it is equally cru- 
cial to develop phenomenological theories so that one 
can ext ract the pairing symmetry from the experimen- 
tal dat a 1 30 1 31 1 such as the Andreev bound states^ESl ne ar 
the edges of the superconductors. Note that the Andreev 
edge state^ in a superconductor is tied up with the pair- 
ing symmetry in the bulk. In addition, recent break- 
throughs in the Fourier-transforme d sca nning tunneling 
spectroscopy (FT-STS) experiment er 5 ! 36 ! allow further in- 
sight into the edge states with momentum resolutions. In 
these experiments, not only the spatial profile of the lo- 
cal density of states (LDOS) can be measured, the peaks 
of the LDOS in the momentum space can also be deter- 
mined by appropriate Fourier analysis of the experimen- 
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Zigzag edge 


Flat edge 


Pairing symmetry 


yes 


no 


Px or / 


no 


yes 


Py 


yes 


yes 




no 


no 


d x 2_ y 2 or s 



TABLE I: Existence of Andreev edge state at zigzag and flat 
edges and its implication for pairing symmetry. 



tal data. In a letter published by one of the authors 33 , 
a theoretical approach was developed to compute the 
momentum-resolved LDOS for the Andreev edge state 
in sodium cobalt oxide with /-wave pairing symmetry. 
The exponential decay away from the boundary can be 
compared with the experiments directly, while the depen- 
dence upon the transverse momentum (along the edge 
where the system is translational invariant ) can be seem 
in Fourier space through scattering processes. Here, we 
elaborate and extend the previous work by considering 
gap functions of p-, d- and /-pairing at both zigzag and 
flat edges and predict the position of the sharp peaks 
that can be observed in FT-STS experiments. 

We start with the two dimensional (2D) Bogoliubov-de 
Gennes Hamiltonian and map the semi- infinite triangular 
lattice to a collection of one-dimensional (ID) chains, la- 
beled by the transverse momentum along the boundary. 
Due to the hidden structure of these effective ID models, 
the AES can be categorized into the positive and neg- 
ative Witten parity states^ in supersymmetric (SUSY) 
algebra. For readers no familiar with the Witten parity 
and the SUSY algebra, we have included a brief intro- 
duction in Appendix A. By computing the Witten par- 
ity states constrained by the boundary conditions, the 
LDOS with specific transverse momentum is obtained. 
Furthermore, we can predict the hot spots in FT-STS by 
spotting all momentum differences between sharp peaks 
in the LDOS. Our results show that the existence of AES 
sensitively depends on the pairing symmetry and the edge 
topology and can thus be used as a good indicator of the 
underlying pairing symmetry. The existence of the AES 
for different pairing symmetries and edge topologies are 
summarized in Table. I. Finally, following an elegant 
gauge argument devised by Oshikaw d 38 * 39 !, we also find 
that the phase diagram for the AES crucially depends on 
the nodal points on the Fermi surface where the pairing 
amplitude vanishes. 

The rest of paper is organized as the followings. In Sec. 
II, we introduce the 2D Bogoliubov-dc Gennes Hamilto- 
nian for a triangular lattice with the zigzag boundary 
topology. By transforming the Hamiltonian into Super- 
symmetric form and use the generalized Bloch state, the 
LDOS of AES is obtained. In Sec. Ill, in the same spirit 
and method, we will compute the LDOS of AES for the 
flat edge. We will discuss about the gauge argument of 
phase diagram and draw a conclusion in Sec. IV. 



II. BOGOLIUBOV-DE GENNES 
HAMILTONIAN AT ZIGZAG EDGE 

To accommodate different pairing symmetries within 
one theoretical framework, it is convenient to start from 
the Bogoliubov-de Gennes (BdG) HamiltoniarP^l, 

H BdG = t 4Wc,(r')-^4(r)c„(r) 

+ [A*(r,r / )c T (r)c i (r') + A(r,r')c{(r / )4(r)],(l) 
<r,r') 

where only the nearest-neighbor hopping and pairing are 
included. Because the particle-hole symmetry is absent 
in the triangular lattice, the sign of the hopping ampli- 
tude t is crucial. Recent experiment d 41 * 42 ! suggest that 
the maximum of the band occurs at the T point, which 
implies t > 0. The pairing amplitudes are either sym- 
metric A(r,r') = A(r',r) or antisymmetric — A(r',r) de- 
pending on the Cooper pairs are spin singlets or triplets. 

In this paper, we will discuss two natural boundary 
topologies of a triangular lattice - zigzag and flat edges, 
as showed in Fig. [T] and Fig. [13] respectively. The con- 
ventions for the spatial coordinates and also the pairing 
symmetries can be found in the figures as well. For in- 
stance, the zigzag edge is chosen to lie in the z/-axis and 
the flat edge along the x-axis in our convention. 

We start with the zigzag edge first, by cutting the in- 
finite triangular lattice along the y-axis. Note that the 
semi-infinite lattice is still translational invariant along 
the boundary and thus can be mapped onto a collection 
of semi-inifinitc ID chains, carrying definite transverse 
momentum k y after partial Fourier transformation. One 
important subtlety about partial Fourier transformation 
is the folding of Brillouin zone. The conventional hexag- 
onal shape must be reshaped into appropriate rectan- 
gular one so that the summations over k x and k y are 
decoupled 43 . For the zigzag edge, the reconstruct rect- 
angle Brillouin zone is shown in the bottom of Figs. [T] 
[8] and [10] After the partial Fourier transformation, the 
Hamiltonian for the collection of the effective ID chains 
along x-direction is 



ky \ 




(2) 



with v = f,d and p, which are denoted as /-, d- and p- 
wave pairing respectively. Here we introduce the Nambu 

basis ^(k y ) — c^(x,k y ) , C|(x, — k y ) and the semi- 
infinite matrix for the hopping term of semi-infinite ID 
chains, 
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with the effective hopping amplitude t\ = 2t cos(V3fc«/2) 
and t-2 = t. The momentum dependence of the matrix 
elements is a consequence of the partial Fourier trans- 
formation. The pairing potential V v with different sym- 
metries will be studied in details in the following subsec- 
tions. 




A. /-wave paring 




We start with the AES of /-wave pairing symmetry 
at zigzag edge. The /-wave symmetry carries angular 
momentum I — 3 and thus corresponds to spin-triplet 
pairing required by Fermi statistics, ft implies that the 
pairing potential is antisymmetric, A(r,r') = — A(r',r). 
Taking the tight-binding approximation, the pairing po- 
tential is rather simple A(r,r') = A(8) = Acos(36*) with 
the relative angle 9 — 2mr/6 where n is an integer. The 
sign convention for different bond orientations is fixed in 
Fig. [I] We can solve for the nodal lines by setting the gap 
function to zero, [cos(fca;/2) — cos (\/3fc a /2)] sin^^) = 
0. These nodal line are drawn in the reshaped Brillouin 
zone in Fig. [TJ At different fillings (chemical potentials) , 
the nodal points are the intersections of the Fermi surface 
contour and the nodal lines. These nodal points turn out 
to be the key for determining the structure of the phase 
diagrams for the AES. The presence of the open bound- 
ary complicates the story and we need to write down the 
pairing potential in the coordinate space. After some al- 
gebra, the semi-infinite matrix V f of Eq. ([2]) takes the 
form, 
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with Ai = 2Acos (y/3k y /2). A simple unitary transfor- 
mation brings the Hamiltonian into SUSY form described 
in Appendix A. The effective Hamiltonia n 1 37 * 44 ! in canon- 
ical SUSY notation is 



ky \ 



A v 
At 



(5) 



where the matrix A v takes the general form 

/ -fi Tf T% • • • \ 
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Although we concentrate on the /-wave symmetry in this 
section, the derivations of the matrix elements of A v are 
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FIG. 1: (Color Online) Gap function with the /-wave sym- 
metry at the zigzag edge of a triangular lattice. The sign 
convention of the pairing potential is shown in the shaded 
hexagon. The bottom figure represents the Fermi surface in 
the reshaped Brillouin zone for the zigzag edge. The nodal 
lines of the /-wave gap function are shown in blue lines and 
the nodal points are the intersections of the Fermi surface 
contour and the nodal lines. 



completely general and work for different pairing symme- 
tries. 

For current case, = —Vf for /-wave pairing, the 
new basis for the SUSY form is 



and the matrix elements of Af are 



ci(x,k y ) c^(x, k y ) 

C[{X, ky) + cj(lE, — ky) 



(7) 



r f - = 
1,1 

r f - = 

~2,2 



2{t =F A) cos 



t ± A. 



V3, 



(8) 



It will become clear later that T( ^ T{ and T( ^ T/ are 
the crucial for the existence of the edge states. 

For the Hamiltonian in Eq. ([5]), the zero-energy states 
are "nodal" , i.e. half of the components in the spinor 
vanish, and can be classified by the so-called SUSY parity 
(see Appendix A), 




I*. 




(9) 



It is straightforward to show that the Harper equations 
become decoupled for the zero-energy states and simplify 
a bit. The solution with positive Witten parity ip+(x) is 
annihilated by A\, i.e. it belongs to the null space of the 
operator. Similarly, the solution with negative Witten 
parity ip-(x) spans the null space of the operator A v . 
It is worth emphasizing that bring the Hamiltonian into 



4 



the SUSY form simplifies the algebra and allows analytic 
calculations for AES as derived here. 

To include the open boundary condition, the edge state 
can be constructed by the generalized Bloch theorerrP^l. 
Taking states with negative Witten parity as a work- 
ing example, one can construct an edge state from ap- 
propriate linear combinations of the zero-energy modes, 
ip-(x) = J2-y a i( z t) x ■ Since the zero energy modes sat- 
isfy A L ,ip-(x) = 0, z is a solution of the following char- 
acteristic equation, 
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(10) 



It is clear that the algebraic equation gives four solutions 
of z for the given chemical potential and the transverse 
momentum. However, not all solutions are allowed. For 
the infinite lattice, the wave function must remain finite 
at infinities, ^(oo)! < oo and \ip(— oo)| < oo. It implies 
that only \z\ = 1 solutions are allowed. These are the 
plane- wave solutions with real momentum defined as z = 
e lk . However, for an open boundary with zigzag shape, 
the boundary conditions change to 

^(-1)=0, ip(Q)=Q, h/>(oo)| < oo. (11) 

Thus, \z\ < 1 is required to keep the wave function finite 
which is less strict than the \z\ = 1 criterion for trans- 
lational invariant systems. However, we have additional 
two boundaries conditions at x = 0,-1, the edge state 
does not always exist, unless we have enough |z 7 | < 1 
zero-modes to construct the edge states. 

Here comes the simple counting. If all of the four solu- 
tions satisfy |z 7 | < 1, we can construct two edge states. 
If three solutions are found, one edge state can be con- 
structed. Otherwise, there will be no edge state. In the 
case of the /-wave pairing symmetry, we plot the magni- 
tude of the solutions \zJ\ as a function of the transverse 
momentum k y in Fig. [2] The z-plot sensitively depends 
on the chemical potential \x. 

Now we would like to explain how to obtain the phase 
diagram for AES from the z-plots. We start with the 
first z-plot (upper left) in Fig. [2] where the chemical po- 
tential is fi/t = 4 and the pairing potential is A/t — 0.4. 
There are four intersections with \z\ = 1 dashed line. 
These are the nodal points. At larger momentum, the 
| z | = 1 dashed line intersects with one solution (orange 
line) and gives rise to the nodal point. At small mo- 
mentum, the dashed line intersects with two degenerate 
solutions (orange and blue lines) at the same time and 
corresponds to a pair of degenerate nodal points. These 
nodal points correspond to the single and double circles 
in the phase diagram. Now we can proceed to determine 
how many edge states I 1 ?-) with negative Witten parity 
can be found. Near the zone boundary k y — n/y/3, there 
are two solutions (green and blue lines) with \z\ < 1. 
Since there are two constraints from the zigzag bound- 
ary, no edge state can be constructed. Passing the nodal 
point, there are three solutions (green, blue and orange 
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FIG. 2: (Color Online) The k y momentum dependence of \z\ 
for the generalized Bloch states with the /-wave symmetry at 
the zigzag edge. The lines with different colors represent four 
solutions of the Bloch state with the parameters, t = 1 and 
A = 0.4. The chemical potentials in the top-left and top-right 
figures are fj,/t = 4 and fj,/t = 1 respectively. The bottom-left 
and bottome-right figures are for fi/t — —1 and fj,/t — —2.5. 



lines) and thus one edge state starts to emerge. The AES 
with negative Witten parity is marked by yellow color in 
the phase diagram. Moving toward to zone center, the 
number of desired solution reduces to one (green line) af- 
ter passing the two- fold degenerate nodal point. Thus, no 
edge state in presence in this regime. Due to the parity 
symmetry in y-direction, the phase diagram is symmetric 
when k„ —> — k„ 



What about the edge state 



V?+) with positive Wit- 



ten parity? One should repeat the derivation for the 
characteristic equation and look for \z\ < 1 solutions to 
construct the edge states again. However, there is some 
symmetry hidden in the algebraic equation and the rep- 
etition is not necessary. Since the matrices A and A' are 
hermitian conjugate to each other, the algebraic equation 
for the positive Wittien parity modes can be obtained by 
1/z in Eq. 
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replacing z 

ing solutions for positive Witten parity can be calculated 
from the \z\ 



That is to say, the decay- 
ty can be calculated 
This relation is very 
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> 1 solutions in Eq 
helpful in constructing the remaining part of the phase 
diagram. Near the zone center in the first z-plot (upper 
left) in Fig. [2] there are three \z\ > 1 solutions and cor- 
respond to one edge state with positive Witten parity. 
In other regimes, no such edge state exists. Combining 
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FIG. 3: (Color Online) Phase diagram for AES with the 
/-wave pairing at different chemical potentials. The single 
point circle mark the nodal points without degeneracy while 
the double circle denote the two-fold degenerate nodal points. 
The green/yellow colors denote the SUSY parity ±1 and the 
single/double lines mean one/two-fold degenerate edge states. 
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FIG. 4: (Color Online) LDOS for the /-wave pairing (top fig- 
ure) along the a;-direction at different transverse momentum 
k y at the chemical potential fi/t = 4. The bottom figure shows 
the spatial trend of the integrated LDOS over the Brillouin 
zone that can be measured directly from STM experiments. 



the results for both Witten parities, the first part of the 
phase diagram in Fig. [3] is obtained. 

Since we compute the value of z for each transverse 
momentum k y , the quasiparticle wave function of Bloch 
states can be obtain straightforwardly. Thus, in addition 
to the phase diagram, we can also compute the LDOS of 
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FIG. 5: (Color Online) momentum resolved (top) and the in- 
tegrated (bottom) LDOS for the /-wave pairing at the chem- 
ical potential fi/t = 1. 



the edge state at specific transverse momentum k y . We 
can also integrate over the Brillouin zone to obtain the 
spatial profile for LDOS that can be measured directly 
in the STM experiments. Furthermore, the momentum- 
resolved LDOS provides additional information about the 
enhanced spectral weight of the quasi-particles at specific 
transverse momenta. Thus, we can predict the evolution 
of the so-called "hot spots" in the FT-STS experiments. 

Let us elaborate on the physical properties of the 
AES now. In order to visualize these edge states bet- 
ter, we calculate the local density of states D(x, k y ) — 
J2j l'0i( a ')l ^C^) versus transverse momentum k y , as 
shown in the top panels of Figs. [4] [5] and [6] at different 
chemical potentials. Noted that the edge states merge 
into the bulk at the nodal points and the weighting of 
the LDOS is suppressed to zero. Furthermore, the lattice 
approach reveals a much richer spatial structure in com- 
parison with the conventional Andreev equations in the 
continuous limit. For instance, the LDOS has a strong 
dependence on the transverse momentum with transpar- 
ent peak structures. For 2 < fj,/t < 6, there are three 
peaks separated by the nodal points and the peak posi- 
tions change with the chemical potential. At n/t = 2, 
the outer peaks move to the boundary of Brillouin zone 
and merge into one. Therefore, for < fj,/t < 2, there are 
only two peaks located at the center and the boundary 
of the Brillouin zone and the locations of the peaks do 
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FIG. 6: (Color Online) momentum resolved (top) and the in- 
tegrated (bottom) LDOS for the /-wave pairing at the chem- 
ical potential fj,/t = —1. 
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FIG. 7: (Color Online) Predicted hot spots in FT-STS ex- 
periment for the /-wave symmetry near the zigzag edge. The 
hot spots are obtained by locating the momentum difference 
between large peaks in LDOS. After /i/t < 2, the second peak 
disappears since the outer peaks merge into one at the bound- 
ary of Brillouin zone. 



zone. Thus, the momentum transfer is always that 
is half of the Brillouin zone. 



B. d X y-wave pairing 



not change with the chemical potential. Further reduc- 
ing the chemical potential to the regime —2 < /.i/t < 0, 
the relative weights of the peaks change but the locations 
remain fixed. 

By integrating over the Brillouin zone, we can com- 
pute the spatial profile of the LDOS in coordinate space 
as shown in the bottom panels of Figs. |4j [5] and [6] at dif- 
ferent chemical potentials. On top of the decaying trend, 
the LDOS also shows non-trivial oscillation due to quan- 
tum interferences due to different zero modes. These 
oscillations can only be captured faithfully in the lattice 
approach. For instance, at [ijt = 4, the LDOS at the 
outmost edge site is not the largest as one would naively 
expect so in the continuous theory. Furthermore, the de- 
cay length is smaller as the chemical potential decreases. 

The momentum-resolved LDOS can also help us to 
determine the hot spots due to quasi-particle scatter- 
ing/interferences in FT-STS experiments. By Fourier 
analysis of the STM data, the momentum transfer be- 
tween quasi-particle scattering is revealed. The momen- 
tum transfer associated with the scattering process be- 
tween peaks in LDOS will emerge after Fourier trans- 
formation. In Fig. [7] the momentum transfers between 
peaks in LDOS are plotted versus the chemical potential. 
For /i/t > 2, there are three peaks giving two specific mo- 
mentum transfers. For /i/t < 2, there are only two peaks 
located at the center and the boundary of the Brillouin 



For easier experimental comparisons, we would also 
work out some other pairing symmetries explicitly. Since 
the derivations are rather similar, we would skip the re- 
peated parts and concentrated on the different outcomes. 
Now we turn to the d xy pairing symmetry at the zigzag 
edge. For d xy pairing symmetry, Cooper pairs form spin 
singlets and the gap function in the coordinate space 
is thus symmetric, A(r,r') = A(r',r). Again, within 
the tight-binding approximations, the pairing potential 
is rather simple, A(r,r') = A sin 28, with relative angle 
8 = 2nir/6 where n is an integer. The nodal lines, satisfy- 
ing the constraint sin(k x /2)sm(\/3ky/2) — 0, are shown 
in the reconstructed Brillouin zone in Fig. [HJ The Hamil- 
tonian for the hopping is identically the same so that we 
do not put it down again. On the other hand, the pairing 
potential consists of another semi- infinite matrix Vd, 






-iA 2 











iA 2 





-iA 2 











iA 2 





-iA 2 











iA 2 





-iA 2 



V 



(12) 



with the effective ID pairing potential A2 — 
\/3 A sm(\/3ky/2). Note that the next nearest-neighbor 
pairing potentials are absent due to the nodal structure 
of d xy -wave pairing symmetry along the cc-direction (see 




FIG. 8: (Color Online) Gap function with the d xy symmetry 
at the zigzag edge of a triangular lattice. The bottom figure 
represents the reshaped Brillouin zone, nodal lines and nodal 
points for the d xy symmetric gap function with the same con- 
vention as explained in the /-wave case. 



FIG. 9: (Color Online) Phase diagram for AES with the d xy 
pairing in the presence of the zigzag edge. The meanings of 
the labels are the same as in the /-wave case. 



nodal points move backward to the center again. For 
—3 < fi/t < —2, no edge state can be found. It is worth 
mentioning that the nodal point connecting edge states 
with opposite Witten parities must be two-fold degener- 
ate by simple counting. Finally, we also calculated the 
hot spots at different chemical potentials, as shown in 



Fig. 12 which can be measured in FT-STS experiment. 



Fig. [8j). Making use oiVd = T'\, a unitary transforma- 
tion is devised, 



C^(^X ■ ) % C-^-i^X ^ fay ) 



(13) 



to bring the BdG Hamiltonian into the SUSY form in 
Eq.@. Although the pairing symmetry is different, the 
structure of the SUSY Hamiltonian remain the same 
form. After some algebra, the off-diagonal components 
of the semi-infinite matrix Ad are, 



Tfj = 2£cos 



T - — t 




/a/3 
=F \/3Asin I ~^-k y 



(14) 



As mentioned before, the hidden SUSY in the BdG 
Hamiltonian makes the zero-energy modes nodal for all 
pairing symmetries. Repeating the same calculations, the 
z-plots are obtained at different chemical potentials. The 
only differences are the matrix elements and 
due to different pairing symmetry. By counting the de- 
caying modes with \z\ < 1, we can construct the phase 
diagram for AES with d xy pairing symmetry as shown 
in Fig. |9| The phase diagram for d xy symmetry ap- 
pears to be much simpler since the number of nodes are 
reduced and the only double node lie in k y — 0. Start- 
ing from the regime 2 < fi/t < 6, there exists an edge 
state with the positive/negative Witten parity depending 
on the sign of the transverse momentum. When reach- 
ing fi/t = 2, the nodal points move to the boundary of 
the reshaped Brillouin zone so that the edge state ex- 
ists for every transverse momentum. Further reducing 
the chemical potential to the regime —2 < fi/t < 2, the 



(J. pa;- wave paring 

We come to the last case at the zigzag edge - the 
p x pairing symmetry. Within the tight-binding ap- 
proximations, the gap function is A(r,r') = Asin#, 
with relative angle 9 = 2mr/6 where n is an inte- 
ger. The nodal lines in the momentum space, as 
shown in Fig. |10| is determined by the constraint, 
[2cos(k x /2) + cos(V2k y /2)]sin(k x /2) = 0. Following 
the same steps, the semi-infinite matrix V p 

( A 3 A Q 
-A 3 A 3 A 
-A -A 3 A 3 A 
-A -A 3 A 3 



V 



with the effective gap potential A 3 = A sin (\/3fey/2). It 
is clear that V p = —VJ,. Since the semi-infinite matrix 
V p share the same property as V '/ for the /-wave pairing, 
the same basis, Eq.([7]), can utilized to bring the BdG 
Hamiltonian into the SUSY form. 

After some algebra, the matrix elements of the semi- 
infinite matrix A p in Eq.([5]) can be computed, 



(15) 



Tf l = (2i±A)cos 



Tl- 2 = t±A. 




(16) 



Following the same steps to obtain the z-plot, we can 
count the number of decaying modes with \z\ < 1. The 
same construction leads to the phase diagram of AES for 
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-27T -7T 7T 27T 



FIG. 10: (Color Online) Gap function with the p x symme- 
try at the zigzag edge of a triangular lattice. The bottom 
figure represents the reshaped Brillouin zone, nodal lines and 
nodal points for the p x symmetric gap function with the same 
convention as explained in the /-wave case. 



k y =-7r/V3 o n /^ } 

l m I 2<)l/t<6 




FIG. 12: (Color Online) Predicted hot spots in FT-STS ex- 
periment for the d xy or p x pairing symmetries near the zigzag 
edge. The hot spots are obtained by locating the momentum 
difference between large peaks in LDOS. 



instead. Later, we will find that it also happens for the 
p y pairing symmetry at the flat edge. Again, the under- 
lying reason is that the gap function only changes signs 
across the open boundary of the system. 



-2<ju/t<2 



III. BOGOLIUBOV-DE GENNES 
HAMILTONIAN AT FLAT EDGE 



-3</i/t<-2 



FIG. 11: (Color Online) Phase diagram for AES with the p x 
pairing in the presence of the zigzag edge. The meanings of 
the labels are the same as in the /-wave case. 



the p x pairing symmetry as plotted in Fig. [TT] Although 
we do not show the momentum-resolved LDOS for the 
present case, it can be computed in a similar way as 
for the /-wave pairing. Fig. [12] shows the evolution of 
the momentum transfer between the peaks in LDOS at 
different chemical potentials and can be compared with 
the hot spots in the FT-STS measurements. 
As Fig. 



11 shows, for the p x pairing symmetry, all 



edge states live in the null space of the scmi-inifinite ma- 
trix Ajj, which are rather different from the /- and d- 
wave symmetries. That is to say, only AES with positive 
Witten parity (according to the our convention here) ex- 
ists! The qualitative difference arises from the sign of the 
gap function across the open boundary. For the p x pair- 
ing symmetry, the pairing potentials at the edge sites all 
share the same sign. The pairing potential only changes 
signs when crossing the edge along the y-direction. As a 
result, the null space of the semi-infinite matrix A p van- 
ishes and all edge states belong to the null space of A P 



By cutting the triangular lattice in another direction 
(along the x-axis), we end up with a semi-infinite lat- 
tice with a flat edge as shown in Figs. 13 and 15 



Since the semi-infinite lattice is still translational invari- 
ant along the x-direction, the semi-infinte can be brought 
into the sum of the ID chains by partial Fourier trans- 
formation along the edge direction. Noted that, to main- 
tain the Fermi statistics between the lattice operators, 
the Brillouin zone must be reshaped in a different way 
as shown in Figs. [13] and [15] In the Nambu basis, 

&(k x ,y) = c\(k x ,y) , C] {-k Xl y) , The BdG Hamilto- 

nian of the ^-wave pairing symmetry can be represented 



H V u 
Vl -H 



(17) 



Here Ti. is a semi-infinite matrix for the effective hopping 
in the ID chains labeled by different momentum k x , 



H 



( -ft ti 

ti -m *i 

o ti -jii ti o 

ti -pi ti 



V 



(18) 
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-2<n/t<6 



-3<n/t<-2 



FIG. 14: Color Online) Phase diagram for AES with the d xy 
pairing in the presence of the flat edge. The meanings of the 
labels are the same as in the /-wave case. 



FIG. 13: (Color Online) Gap function with the d xy symme- 
try at the flat edge of a triangular lattice. The bottom figure 
represents the reshaped Brillouin zone, nodal lines and nodal 
points for the d xy symmetric gap function with the same con- 
vention as explained in the /-wave case. 



with the momentum-dependent hopping amplitude t\ = 
2t cos(k x /2). Note that the chemical potential is renor- 
malizcd, Jl = /i—2tcos(k x ) after the partial Fourier trans- 
formation. Not only the hopping matrix is different from 
that for the zigzag edge, the other semi-infinite matrix V v 
for the pairing potentials with the z/-wave pairing sym- 
metry would be different as well. In the following, we will 
study the phase diagrams of AES with different pairing 
symmetries near the flat edge in details. 



A. d X y-wave pairing 

For the d xy pairing symmetry, the AES exists for both 
the zigzag and the flat edges. After partial Fourier trans- 
formation in the x-direction, the pairing potential Vd in 
Eq.(17l can be explicitly worked out, 



V d 






-iAi 
















-iAi 











zAi 





-zAi 











iAi 





-iAi 



V 



(19) 



with Ai = \/3A sin(fca./2). To obtain the zero-energy 
states, it is convenient to bring the effective Hamiltonian 
into the SUSY form as in the zigzag case, 




(20) 



where v denotes the pairing symmetry considered. For 
the flat edge, the semi-infinite matrix A v is simpler than 
that for the 7A'gL , &% edge since it only has two off-diagonal 



rows instead of four, 



A-u — 



( ~v 

T{ —jl f{ 



Tf 



T{ -Jl T{ 



\ 



(21) 



The matrix elements can be worked out explicitly from 
the semi-infinite matrix V v in Eq. ( 17 1 which depends on 



the pairing symmetry. For the d xy pairing symmetry, the 
semi-infinite matrix satisfies Vd = V\. Thus, the unitary 
transformation to the SUSY form is 



c l( k x,y) ~icU-k x ,y) 
ci(k x ,y) + ic\(-k x ,y) 



(22) 



It is straightforward to work out the matrix elements of 
the semi-infinie matrix Ad, 



Tfj = 2icos 



(23) 



Again, the zero-energy modes exhibit the nodal struc- 
ture and can be classified into two categories with oppo- 
site Witten parities, 



1*-) = 




1*+) = 



o 



(24) 



Here ip-(y) and ip+(y) belong to the null space of the 
semi-infinite matrices A v and A\ respectively. The edge 
state is constructed from the generalized Bloch theorem. 
For instance, the edge state with negative Witten parity 
is ip-(y) = J2\ a ^( z ^) y '■> where z satisfies, 



T?z = Jl. 



(25) 



The above algebraic equation gives two solutions for z. 
In the presence of the flat edge, the boundary conditions 
are slightly different, 



^(0) = 0, tp(oo) < oo. 



(26) 
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FIG. 15: (Color Online) Gap function with the p y symmetry 
at the flat edge of a triangular lattice. The bottom figure 
represents the reshaped Brillouin zone, nodal lines and nodal 
points for the p y symmetric gap function with the same con- 
vention as explained in the /-wave case. 



As before, only decaying modes with \z\ < 1 are allowed. 
But, only one constraint is required at the flat edge in 
contrast to the two constraints for the zigzag edge. The 
simplification is due to the missing matrix elements T% 

and T£ at the flat edge which makes searching for the 
AES much easier here. The phase diagram for the AES 
with eL 



j, xy pairing symmetry is shown in Fig. 14 Using 
the Bloch wave function of those edge states, we obtain 
the LDOS for all transverse momenta k x . Then, we can 
proceed to predict the sharp peaks in STM data after 
Fourier analysis by finding out the momentum transfer 
between peaks in the LDOS. The results are plotted in 
Fig. 17 versus the chemical potential fi/t. 



B. 



Py-wsve pairing 



We now continue to study the AES with the p y -wave 
pairing symmetry at the flat edge as shown in Fig. |15| 
The nearest-neighbor gap amplitude of p^-wave pairing 
takes the form, A(r,r') = A cos 6, with relative angle 
6 = 0, 7r/3, 27r/3, 5ir/3. The nodal lines in reshaped 
Brilliouin zone, shown in Fig. |15| are determined by the 
equation sm(^/3k y /2) cos(fc 2 ,/2) = 0. Again, applying 
partial Fourier transformation to the gap function, we 
obtain the semi-infinite matrix for the pairing potential, 



( A 2 _0 

-A 2 A 2 

-A 2 A 2 

-A 2 A 2 



V 



(27) 



-2<///t<6 



-3<^/t<-2 



FIG. 16: Color Online) Phase diagram for AES with the p y 
pairing in the presence of the fiat edge. The meanings of the 
labels are the same as in the /-wave case. 




FIG. 17: (Color Online) Predicted hot spots in FT-STS ex- 
periment for the d xy or p y pairing symmetries near the flat 
edge. The hot spots are obtained by locating the momentum 
difference between large peaks in LDOS. 



with A 2 = \/3 A cos (k x /2). Because oiV v — "P^, the 
Hamiltonian can be brought into SUSY form in the basis, 



ci(k x ,y) - c\(-k X) y) 



C[{k xi y) +c\(-k x ,y) 



(28) 



After straightforward algebra, the components of the ma- 
trix A p for the Pj,-wave pairing are 



rpp 

1,1 



(2t ± A) cos 



(29) 



The effective ID chains for the flat edge are univer- 
sal. Thus, the whole discussions and calculations for the 
d-wave pairing with the flat edge can be applied h ere . 
Substituting the matrix elements Tf and into Eq. ( 25 1 
and combining the boundary conditions of the flat edge, 
Eq.(26), we obtain the phase diagram of AES for the 

As we men- 



1G 



p y pairing symmetry as shown in Fig. 
tioned in previous section, the p-wave pairing potential 
changes sign across the edge boundary and lead to edge 
states with positive Witten parity only. Finally, using 
the Bloch wave function of those edge states, we obtain 
the LDOS for all transverse momenta k x . Then, we can 
proceed to predict the sharp peaks in STM data after 
Fourier analysis by finding out the momentum transfer 
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between peaks in the LDOS. The results are plotted in 



Fig. 17 versus the chemical potential fi/t. 



IV. DISCUSSIONS AND CONCLUSIONS 

There are simple patterns behind the phase diagrams 
we investigated in previous sections. For instance, the 
total Witten parity changes by one when crossing a sin- 
gle nodal point while it changes by two across the double 
nodal point. It seems that the global structure of the 
phase diagram is dictated by the nodal points. These 
observations are indeed correct and can be explained by 
the continuity of z-plots. However, there is something 
deeper about why the nodal points are so important. In 
the following, we would like to make use of Oshikawa's 
gauge argument! 38 * 39 ! and explain why edge states can 
only start/end at the nodal points. 

Suppose we wrap up the semi-infinite lattice into tubu- 
ral conformation and adiabatically thread a unit flux 
•I>o = 2-7T through it. The flux insetion changes the Hamil- 
tonian from ff (<£ = 0) to a different topological sector 
H(Q = <f>o). If the ground state of original Hamilto- 
nian is protected by a gap, the insertion of a unit flux 
also transforms the ground state from |^ ) to \^f' Q ) of 
the same energy. The flux insertion can be achieved by 
the constant vector potential Ad = $o/Ld with the cir- 
cumference of the tube Ld in the transverse direction of 
Xd- Meanwhile, the constant vector potential commutes 
with the transverse momentum Pd that implies that the 
momentum remains constant in the whole adiabatic pro- 
cedure, i.e. Pdl^'o) — Pol^o)- Before being able to com- 
pare j^o) t° l^o)' we nee d to restore the Hamiltonian 
to the same topological sector H($ = 0). The required 
large gauge transformation is 



U = exp 



2?r x - A 



(30) 



where hf is the electron density at r. Now UH(^o)W — 
-ff(O), so U\^' Q ) is a ground state of the original Hamil- 
tonian -ff(O). The momentum of the new ground state 
can be evaluated straightforwardly, PdU\^f' ) = (UPd + 
[P d ,U})\%) = (P + 2nN/Ld)U\%). The total num- 
ber of electrons can be separated into bulk and edge 
parts, N = Nb + Ne- The momentum shift is then, 
AP = 2nN/L d = 2-nCv h + 2ms e , with v h = N B /V a and 
v e = Ne I Ld are the filling factors of the lattice and edge 
respectively. The area of the system is V a and the trans- 
verse size is C = V a /L d . 

Now, let us focus on the edge part. If we fill in only one 
edge state with v e = l/Ld, the momentum shift by the 
flux-insertion-removal trick is AP = 2tt /Ld- The number 
of edge state then equal to the ground state degeneracy. 
Since the gauge argument holds only when the ground 
state is protected by a finite gap, we can move one edge 
state to another between the nodal points. 



Another interesting perspective is to relate the exis- 
tence of AES to the underlying structure of the effec- 
tive ID modelP The semi-infintc lattice can be mapped 
into effective ID models. By choosing an appropriate 
unit cell, the ID chain will contain only nearest-neighbor 
hopping described by the general Hamiltonian 



H = C{ <g) R + C x <g> R f + C <g> 1, 



(31) 



where Ci is the hopping matrix connecting nearest- 
neighbor cells and Co = C for the hopping within the 
cell. The matrices Co and Ci are square matrices with 
s rows, where s is the number of effective lattice site in 
the unit cell. The semi-infinite matrix (R)^' = <5;+i.i is 
the displacement operator on the effective ID chain. We 
construct the edge states from the Bloch states, = 
J2 y a 7 7 (z 7 ) 1 , where z satisfies det|zCi + iCi + C | = 0. 
The boundary condition is extremely simple in this rep- 
resentation, Ci4>(0) = ^ 7 Ci(a 7 </> 7 ) = 0. Therefore, 
the number of the edge states is the dimension of the 
null space of of Ci. 

If the rank of matrix Ci is full, it means no edge state. 
In fact, the reflection symmetry with respect to the open 
boundary often implies that the rank of Ci is full. For ex- 
ample, the py-wsve pairing symmetry at the zigzag edge, 
one can find out that z in the Bloch state should sat- 
isfy Eq.([l0) with T- 2 = T 2 and Tj = T x . That is to say, 
if z is a solution, 1/z is also a solution. Thus, except 
the nodal points, there are always two zero modes with 
\z\ < 1. Since there are also two constraints, we end up 
with no edge state. One can also check that the reflection 
symmetry makes the rank of the matrix C x full and thus 
leads to no edge state. 

In conclusion, we study the AES with different pairing 
symmetries and boundary topologies on semi-infinite tri- 
angular lattice of Na^OoC^-y^O. By mapping the 2D 
triangular lattice to the ID counterpart, we can obtain 
the phase diagram and calculate the LDOS of the AES 
at both zigzag and flat edges. Surprisingly, the structure 
of the phase diagram crucially relies on the nodal points 
on the Fermi surface and can be explained by an elegant 
gauge argument. Finally, the momentum-resolved LDOS 
allow us to predict the hot spots in Fourier-transformed 
scanning tunneling spectroscopy experiments. 
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APPENDIX A: N = 2 SUPERSYMMETRIC 
QUANTUM MECHANICS 



The effective Hamiltonians in Eqs. ^ and (20 1 can 
be described as the N = 2 SUSY quantum mechanics^, 
where N is the number of supercharge operators. The 



12 



two supercharge operators can be constructed explicitly 



Qi 



H 




Q-2 




(Al) 



One can verify that all SUSY algebra is satisfied. Ac- 
cording to the definition, the SUSY Hamiltonian is 



USY 



= Q\ = Ql = 




(A2) 



Once we know how to diagonalize the SUSY Hamiltonian, 
we can also construct the eigenstates of the supercharge 
operators (our goal here) as well. The SUSY algebra 
relates the E > (the energy of the SUSY Hamiltonian) 
eigenstates with the opposite Witten parities 



I*-) = 
1*+) = 



where the complex supercharges are defined as 



y/2 



(Qi + iQ 2 ) 




(A3) 
(A4) 

(A5) 



Q 



t _ 



V2 



(Qi-iQ 2 ) 




(A6) 



From the transformation of the Witten parities, one can 
realize the energy spectrum of Q\ is symmetric about 
e = 0, i.e. e = ±\E\. On the other hand, the E = 
states satisfy the operator equation, i.e. they live in the 
null space of the complex supercharge Q and , 



QI*-) = o, 

Qt|#+) = 0. 



(A7) 
(A8) 



If we do find some states satisfying the above equation, it 
is called good SUSY because the E = states are anni- 
hilated by supercharge. On the other hand, if we can not 
find any E = state, it is often referred as bad SUSY 
since the ground state carries non-zero supercharge^. 
However, for condensed matter systems, the good SUSY 
gives rise to the zero-energy anomaly while the bad SUSY 
actually makes the energy spectrum symmetric about the 
zero energy without anomaly. 
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